Multi-Agent Reinforcement Learning Based on Representational Communication for Large-Scale Traffic Signal Control

نویسندگان

چکیده

Traffic signal control (TSC) is a challenging problem within intelligent transportation systems and has been tackled using multi-agent reinforcement learning (MARL). While centralized approaches are often infeasible for large-scale TSC problems, decentralized provide scalability but introduce new challenges, such as partial observability. Communication plays critical role in MARL, agents must learn to exchange information messages better understand the system achieve effective coordination. Deep MARL used enable inter-agent communication by protocols differentiable manner. However, many deep frameworks proposed allow communicate with all other at times, which can add existing noise degrade overall performance. In this study, we propose communication-based framework TSC. Our allows each agent policy that dictates “which” part of message sent “to whom”. essence, our enables selectively choose recipients their variable length them. This results flexible mechanism effectively use channel only when necessary. We designed two networks, synthetic $4 \times 4$ grid network real-world based on Pasubio neighborhood Bologna. achieved lowest congestion compared related methods, utilizing notation="LaTeX">$\sim 47-65 \%$ channel. Ablation studies further demonstrated effectiveness policies learned framework.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Reinforcement learning-based multi-agent system for network traffic signal control

A challenging application of artificial intelligence systems involves the scheduling of traffic signals in multi-intersection vehicular networks. This paper introduces a novel use of a multi-agent system and reinforcement learning (RL) framework to obtain an efficient traffic signal control policy. The latter is aimed at minimising the average delay, congestion and likelihood of intersection cr...

متن کامل

Using a Deep Reinforcement Learning Agent for Traffic Signal Control

Ensuring transportation systems are efficient is a priority for modern society. Technological advances have made it possible for transportation systems to collect large volumes of varied data on an unprecedented scale. We propose a traffic signal control system which takes advantage of this new, high quality data, with minimal abstraction compared to other proposed systems. We apply modern deep...

متن کامل

Reinforcement Learning For Adaptive Traffic Signal Control

By 2050, two-thirds of the world’s 9.6 billion people will live in urban areas [2]. In many cities, opportunities to expand urban road networks are limited, so existing roads will need to more efficiently accommodate higher volumes of traffic. Consequently, there is a pressing need for technologically viable, low-cost solutions that can work with existing infrastructure to help alleviate increa...

متن کامل

Reinforcement Learning in Large Multi-agent Systems

Enabling reinforcement learning to be effective in large-scale multi-agent Markov Decisions Problems is a challenging task. To address this problem we propose a multi-agent variant of Q-learning: “Q Updates with Immediate Counterfactual Rewards-learning” (QUICR-learning). Given a global reward function over all agents that the large-scale system is trying to maximize, QUICR-learning breaks down...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Access

سال: 2023

ISSN: ['2169-3536']

DOI: https://doi.org/10.1109/access.2023.3275883